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Abstract 

We study, using ADHM construction, instanton effects in an A/" = 2 superconformal 
Sp{N) gauge theory, arising as effective field theory on a system of N D-3-branes 
near an orientifold 7-plane and 8 D-7-branes in type I' string theory. We work out 
the measure for the collective coordinates of multi-instantons in the gauge theory 
and compare with the measure for the collective coordinates of (— l)-branes in 
the presence of 3- and 7-branes in type I' theory. We analyse the large-TV limit 
of the measure and find that it admits two classes of saddle points: In the first 
class the space of collective coordinates has the geometry of AdS^ x which on 
the string theory side has the interpretation of the D-instantons being stuck on 
the 7-branes and therefore the resulting moduH space being AdS5 x S^, In the 
second class the geometry is AdS^ x /Z2 and on the string theory side it means 
that the D-instantons are free to move in the 10-dimensional bulk. We discuss 
in detail a correlator of four 0(8) flavour currents on the Yang-Mills side, which 
receives contributions from the first type of saddle points only, and show that it 
matches with the correlator obtained from coupling on the string theory side, 
which receives contribution from D-instantons, in perfect accord with the AdS/CFT 
correspondence. In particular we observe that the sectors with odd number of 
instantons give contribution to an 0(8)-odd invariant coupling, thereby breaking 
0(8) down to SO{%) in type I' string theory. We finally discuss correlators related 
to i?^ , which receive contributions from both saddle points. 



1 Introduction 



Dualities, and in particular strong-weak coupling dualities, have shed light on our un- 
derstanding of the dynamics of string theories and Yang-mills theories. More recently 
the conjecture of Maldacena relates the physics of certain conformally invariant large 
N Yang-Mills theories living on 3-branes in various string theories to that of the cor- 
responding bulk string theories in the near horizon geometry (AdS geometry) of the 
3-branes. Many detailed checks have so far confirmed this conjecture and have at the 
same time provided new insights into both the physics of Yang-Mills theories as well 
as that of string theories. In a beautiful paper H], in the context of = 4 Yang-Mills 
theories, this equivalence was extended to orders. On the Yang- Mills side they 
appear as instanton effects, while in the string theory they correspond to certain higher 
derivative couplings induced by stringy instantons. What was remarkable was that in 
the large limit, the moduli space of SU (N) multi-instantons collapses into the "center 
of mass" moduli that live on AdS^ x as predicted by AdS/ CFT correspondence, 
and a set of "relative" moduli whose action is that of a multi D-instanton action in the 
underlying IIB string theory. It was known through the works |^ ^ and that the 
latter contributes to certain R'^ terms in the IIB theory (R being the Riemann tensor). 
Also, it was shown that certain correlators in the Yang-Mills instanton background, had 
a direct correspondence with certain couplings appearing in the string theory via the 
dictionary of the Yang-Mills operators and the bulk operators as given in ^ . 

The purpose of this paper is to extend the results of ref. Q to the case of = 2 Sp{N) 
Yang-Mills theories that appear as the 3-brane world volume theory in the type I' model 
where the 3-branes are living at an orientifold 7-plane together with 8 D-7-branes. The 
near horizon geometry of this system is that of AdS^ x where is a particular Z2 
modding of S^. The 7-brane world volume intersects with X^ on an S"^. This model 
was first studied in refs. |^ following the earlier works [10, 11]. Subsequently the 
order A^ corrections to the AdS/CFT trace anomaly in this model were analyzed in refs. 
]l2| , |l3[. In the bulk theory this correction was traced, in ref. [^], to the presence of 
an term in the 7-brane world volume action. 

In the present work we will consider instantons in the 3-brane world volume theory 
and show that, in the large A^ limit, two types of saddle points are relevant: Those for 
which multi- instanton moduli space is AdS^ x S^, and the fluctuations are given by the 
D-instanton action in type I' theory, and those for which the multi-instanton moduli 
space is AdS^ x /Z2, and the fluctuations are given by the D-instanton action in type 
IIB theory. For the former saddle points the interpretation on the string side is that the 
D-instatons sit at a point on the the 7-branes whereas for the latter ones they can be at 
a point in the whole 10 dimensional bulk. We will study certain correlation functions, 
in the Yang-Mills theory, of the 0(8) flavour currents that couple to 0(8) gauge fields 
in the bulk via AdS/ CFT correspondence. We will see that in the large A^ limit the 
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first type of saddle points are relevant for these correlation functions. Moreover, we 
will show that these correlation functions describe the bulk to boundary propagators 
that connect F'^ vertex to the 0(8) currents on the boundary. The result then is 
obtained by the D-instanton contributions to F'^ in type I' theory or equivalently D- 
string instanton contributions in type I theory |jl4, or world sheet instantons at 



string one-loop level in heterotic theory pq , 17]. We will see that both odd and even 
instanton numbers contribute to this correlator. We will also see that certain correlators 
can receive contributions from instanton configurations whose moduli space is the full 
10-dimensional bulk spacetime AdS^ x S^/Z2. 



Some of the issues developed here have been recently discussed in [18, 19]. Also instanton 
effects in SU (N) superconformal M = 2 gauge theories have been discussed in and. 



in the context of orbifold AdS/CFT correspondence, in ]21] 

The paper is organized as follows. In section 2 we review the 3-brane world volume 
theory and describe the relevant ADHM construction of the multi-instantons. In section 
3 we describe the ADHM measure in terms of integrals over the fields on (— l)-branes 
in a system of (—1)-, 3- and 7-branes. We then go on in section 4 to find the saddle 
point solutions in the large- limit and show that the integral collapses to a "center 
of mass" integral on AdS^ x (i.e. in the 7-brane world volume where 0(8) gauge 
fields live) or AdS^ x S'^/Z2, together with integrals over the fluctuations describing 
the relative positions of D-instantons in type I' or IIB theory respectively. For the first 
saddle point, we will see that both odd and even instantons contribute to the correlation 
function involving four 0(8) currents and give rise to odd and even quartic invariants 
of 0(8). In section 5 we show that the four 0(8) current correlators describe bulk 
to boundary propagators connecting F'^ vertex in AdS^ to four 0(8) currents on the 
boundary of AdS^. We will explicitly show the emergence of the usual tensor in F^ 
vertex. In section 6, we describe the heterotic string computation of term for the 
odd invariant case since this has not appeared in the literature so far. We will also 
discuss B!^ couplings, which receive contributions from both saddle points. Finally in 
section 7 we make concluding remarks. 



2 ADHM construction of A/" = 2 Sp{N) instantons 

The theory on the type I' 3-branes that we are considering here is = 2 Sp{N) 
Yang Mills theory with one hypermultiplet transforming under the antisymmetric rep- 
resentation of Sp{N) and a fundamental hyper multiplet transforming as (A^, 8) under 
Sp{N) X 0(8) with 0(8) being the flavour symmetry arising from the 7-branes. The 
following table includes the fields on the 3-brane world volume together with their 
50(4)/ X S0{4:)e X SO{2) transformation properties. Here the subscript / refers to 
the 50(4) of the world volume (writing 50(4) = 5C/(2)^, we shall label the quantum 
numbers by a, a), E refers to the external 50(4) which is part of the 7-brane world 
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volume (A and Y label the analogous quantum numbers) and finally SO (2) acts on the 
space transverse to the 7-branes. 



D3-brane World-volume content 



Fields 


SO{4)j 


SO{A)e 


S0{2) 


Sp{N) 


0(8) 


v^, 


(2,2) 


(1,1) 





N{2N + 1) 


1 


<P^ 


(1,1) 


(1,1) 


±2 


N{2N + 1) 


1 




(1,1) 


(2,2) 





N(2N - 1) 


1 




(2,1) 


(2,1) 


+1 


N{2N + 1) 


1 




(1,2) 


(2,1) 


-1 


N{2N + 1) 


1 




(2,1) 


(1,2) 


-1 


N{2N-1) 


1 




(1,2) 


(1,2) 


+1 


N{2N-1) 


1 




(1,1) 


(2,1) 





2N 


8 


Va 


(2,1) 


(1,1) 


-1 


2N 


8 


Va 


(1,2) 


(1,1) 


+1 


2N 


8 



It is instructive to compare the above fields with those of 2N 3-brancs in type IIB. 
There the theory is = 4 U{2N) gauge theory. Type I' Sp{N) theory is obtained 
from the M = 4, U(2N) theory by J7 • Z2 projection (apart from the 0{8) fundamental 
fields which appear from 3-brane-7-brane states and we shall discuss them separately in 
the following) . Recall that the A/" = 4 theory has an SU (4) R-symmetry group which 
can be decomposed in terms of S'0(4)e x 50(2) = SU{2)a x SU{2)y x SO{2) that 
appears in the M = 2 theory. Writing also 5*0(4)/ as SU{2)a x SU{2)a we can write 
the M = 4 fields (all in the adjoint of U{2N)) in terms of their representations under 
SU{2)a X SU{2)a X SU{2)a X SU{2)y x 50(2) as 

Vectors : (2,2,1,1,0) 
Fermions : (2, 1, 2, 1, +1), (1, 2, 1, 2, +1), (2, 1, 1, 2, -1), (1, 2, 2, 1, -1) 
Scalars : (1, 1, 2, 2, 0), (1, 1, 1, 1, ±2) 

The last entry here denotes the charge under 50(2). 

projection acts as follows: Z2 is the center of SU (2)y , while assigns a plus sign to 
the Sp{N) subalgebra of U{2N) adjoint and assigns minus to the remaining generators 
of U{2N) namely the ones transforming as the second rank anti-symmetric represen- 
tation of Sp{N). From this it follows that vectors are Sp{N) adjoint and transform 
as (2,2,1,1,0), while the scalars split into two classes: ip^^ that transform as anti- 
symmetric representation of Sp{N) and transforming as adjoint. Similarly fermions 
transforming as (2, 1, 2, 1, -|-1) and their complex conjugate (1, 2, 2, 1, —1) are in the ad- 
joint of Sp{N) while the ones transforming as (1, 2, 1, 2, -|-1) and their complex conjugate 
(2, 1, 1, 2, —1) are in the antisymmetric representation. This is exactly the field content 
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(apart from the fundamentals of 0(8)) described above and in fact even their action is 
just obtained from the = 4 action by this projection. This fact wih be important for 
us in the fohowing because our strategy wih be to use the results of Q for the case of 
U {2N) and project by • Z2. Not only the zero mode analysis of Q can be adapted for 
our case but even the action integrals can be carried over from the = 4 analysis. 



2.1 Vector zero modes 



In the U {2N) theory the ADHM data for k instanton is given in terms of (2A^ + 2k) x 2k 
matrix A of the form |^ 

where A goes over 2N + 2k indices and the 2k indices are split into i = 1, . . . ,k and 
a, d = 1, 2 and Xaa = ^iJ.'^aa- '^^^ matrix A satisfies the constraint 

where fij is a symmetric matrix. Another ingredient in the construction is U which is 
a (2A^ + 2k) X 2A^ matrix and satisfies the orthogonality relation AU = UA = and 
IJU = 1. The projection operator is UU = 1 — A/A. The instanton gauge potential 
= Ud^U gives a self dual field strength of instanton number k. 

We can now go to the Sp{N) case by projecting by 0, which implies that A and U 
satisfy: 

^Af+fcA = A*Qfc, r^Tv+fct^ = U*flN (2.3) 

where * denotes complex conjugation and fi^ is a 2r x 2r matrix with r diagonal blocks 
of (72 each. 

It is clear that A is defined up to the action of constant Sp{N + k) from the left and 
GL{k,R) from the right. Sp{N + k) acts simultaneously on U on the left. U on the 
other hand admits local Sp{N) transformations on the right. Using the freedom on A 
we can bring the matrix b in to the form 



02iVx2A: 



(2.4) 



The residual symmetry of A is Sp{N) subgroup of Sp{N + k) left action and 0{k) action 
defined by 

A ^ ] Ag' X l2x2 (2.5) 

\ U2fcx2Af 9 X J^2x2 J 

with g being an 0{k) element. This residual Sp{N) x 0{k) symmetry will play an 
important role in the next section when we describe the ADHM data using (—1)-, 3-, 
7-brane system. 



^We use the same notation as ref. 
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Writing a = j 2iVx2fc \ constraint on A A then implies that a' is a symmetric 

\ '^2kx2k J 

matrix (i.e. a'(^ai){dj) ~ '^(aj)(di)) therefore transforms as the second rank symmetric 
tensor under 0{k). The constraint also implies that 



D^j = tr2T''{ww + a'a')ij = c = 1, 2, 3. (2.6) 

where r'^ are Pauli matrices. Note that Deis akxh antisymmetric matrix and transforms 
in the adjoint representation of 0{k). Dc will play the role of the D-terms in the 0{k) 
gauge theory of (— l)-brane instantons. It is also clear that w'^ transforms as a bi- 
fundamental of Sp{N) x 0{k) and the superscript on w indicates that it transforms as 
a doublet of SU{2)a- These fields will play the role of (—1)- brane - 3-brane states. 



2.2 Adjoint and antisymmetric fermion zero modes 

Now let us turn to the fermions. Their zero modes can also be obtained by projecting 
the zero modes for A/" = 4 U{2N) theory. The result for the Sp{N) adjoint fermions is 

= U^Mih^F^f^ - uXiaMM^)fu^ (2.7) 
where M'^ is a constant {2N + 2k) x k matrix of Grassmann variables. Writing 

M1 ^ ( 4 ) (2.S, 

the constraints on are: 

= (2.9) 

In particular this implies that M' transforms in the symmetric representation of 0{k). 

Similarly the zero mode expressions for the fermions in the anti-symmetric repre- 
sentation of Sp{N) are given by the above expressions with the collective coordinates 
M.^ replaced by and {M"^)^ replaced by —{M'^)^. This in particular implies that 
M'^ transforms in the anti-symmetric representation of 0{k). 

The fermionic constraints and py transform in the adjoint and the symmetric 
representations of 0(A;)respectively. Note that Ai'^ and carry (-1-1) charge under 
SO{2) while M'^ and carry (—1) charge. As we shall see in the next section, this 
is exactly the structure one finds in the (—1)-, 3-, 7- brane system. 

Finally we will need the explicit expressions of the four supersymmetric and four super- 
conformal exact zero modes. They are given respectively by choosing 
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and 



(2.11) 



2.3 Adjoint and anti-symmetric scalars 

In the U{2N) theory the adjoint scalar tp-^^ transforms as a vector under the SO{Q)r 
symmetry. It satisfies the equation of motion 

D''^^^ = V2i[\-^,\% (2.12) 

The solution is given by: 

i^^ = -±=U{M^fM^-M^fM^)U + ui^'''''^'' ^^""'^^ \ U (2.13) 

2V2 \ 02fcx2JV X 12X2 / 

where is the collective coordinate that satisfies the equation 

L.^AB ^ ^AB (2.14) 

with A"^^ and the operator L defined as: 

= -1-{M^M^ - M^M^) (2.15) 
2v 2 

where = tr2 ivw. Splitting again SU{A)r symmetry into SU{2)a x SU{2)y x S0{2) 
and doing the ■ Z2 projection, which projects ip'^'^ and 99^ into respectively anti- 
symmetric and adjoint representation of Sp{N) wc find that the collective coordinates 
and transform as symmetric and adjoint representations of 0{k) respectively. 
Also as a result of the projection, M. in the above expressions are replaced by {Jv(^)^ 
and -{M^)^. 



2.4 Fundamental fields 

As we mentioned, the theory we are considering also includes hypcrmultiplets that 
transform as bi- fundamental of Sp{N) x 0(8). In fact wc shall be precisely interested 
in computing the correlation function of the 0(8) fiavour currents. The fundamental 
fermion zero mode is 

= tJ^h^hj^ (2.16) 

where r is the 0(8) flavour index and /C's are Grassmann numbers that transform as 
bi-fundamental of 0{k) x 0(8). Note that /C does not transform under 50(4)/ x 50 (4)^. 
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Since the spinor 77"'' couples to the scalar 99+ through the term tr {ip~^r]"'^rj^), then the 
equation of motion for (p^ has an additional term rj^^r]^ on the right hand side of( 2.12| ). 
The effect of this term is the addition of a term 



(Af)., = /CI/C,^ (2.17) 

to the right hand side of equation ( ^.14 ) but only for the component . In summary, 
after the projection of the = 4 U{2N) result, which contains those fields of = 
2 Sp{N) which are in the adjoint and antisymmetric reps, the inclusion of the hypers in 
the fundamental representation is just through the above modification of the constraint 
for <!)+. 



2.5 Multi-instanton measure 

Now we can write down the measure for A;-instantons. It is just integration over the 
collective coordinates discussed above together with the constraints (eqns. (|2.6|), ( ^ ) 
and (|2l^)): 



/ da' dw dfi"^ dfi^ dM'^ dM'^ d<^^^ d<l>+ d<^- dIC 

5iFi) 5{Fl) 5{D^) 5{L ■ <i>^^ - Aj^^f) exp(-ltrfcCl> • Atot) (2.18) 

where Atot = A + Af . For later use, it is convenient to replace the integration over 
and by 

/ (i«>^^ d<^+ S{L ■ - A^^f ) exp(-^trfc$ • A^t) = 

f db^^ db+ db- expi-tikB-^^ ■L-BAB + ^tikB ■ A^t) (2.19) 

Where B-^^ is a 4A: X Ak matrix whose elements and 6^^ are respectively symmetric 
and adjoint reps of 0{k). 

Before analyzing the large N limit of this measure, it will be instructive to make a 
comparison of the above measure with the one for !)(— l)-branes in the presence of 
3-branes and 7-branes. This we will do in the next section. 



3 ADHM measure and D-instantons 



In the last section, we discussed the ADHM measure for the collective coordinates of 
the k instantons in the Sp{N) gauge theory with the specific matter content appearing 
on the type I' 3-branes. In this section we will consider the Higgs branch of a system 
of k (— l)-branes, N 3-branes and 8 of the 7-branes on an orientifold plane and will see 
that, as it is expected |2^, it gives the same measure as the ADHM analysis of the 
last section. The field content appearing on the world volume of the (— l)-branes is 
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D(— l)-brane World- volume content 



Bosons 


Fermions 


SO{^)e 


SO{A)i 


SO{2) 


SO{k) 


Sp{N) 


0(8) 






(2,2) 


(1,1) 





\k{k + l) 


1 


1 


}f 




(1,1) 


(1,1) 


±2 


\k{k-l) 


1 


1 


<d 




(1,1) 


(2,2) 





\k{k + l) 


1 


1 






(1,2) 


(1,2) 


+1 


\k{k + l) 


1 


1 






(2,1) 


(1,2) 


-1 


\k{k-l) 


1 


1 






(2,1) 


(2,1) 


+1 


\k{k + l) 


1 


1 






(1,2) 


(2,1) 


-1 


\k{k-l) 


1 


1 






(1,1) 


(1,2) 





k 


2N 


1 






(1,2) 


(1,1) 


-1 


k 


2N 


1 






(2,1) 


(1,1) 


+1 


k 


2N 


1 




K 


(1,1) 


(1,1) 


-1 


k 


1 
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Here the fields are classified according to their representations under SO{k) gauge theory 
of the world volume action of the (— l)-branes, in which the Sp{N) and 0(8) gauge 
theories of the 3-branes and 7-branes respectively are the global symmetries. In addition 
they carry specific representations of the SO{4)e x S0{4)i x S0{2) which are the 
rotation groups with E denoting the 4 directions transversal to 3-branes and longitudinal 
to 7-branes, I denoting the 4 directions inside 3-branes world volume and SO{2) denotes 
the two transversal direction to the 7-branes. As before, the indices A and Y refer to 
the two SU{2ys in SO{4)e and a and a refer to the two S'?7(2)'s of SO{A)i. It will be 
useful to make comparison with the field content for the ( — 1)-, 3- brane system in type 
IIB that is relevant for the = 4 theory. First of all, we have additional fermionic fields 
/C transforming as bi- fundamentals of SO{k) x 0(8) arising from open strings between 
(— 1) and 7-branes. These describe the collective coordinates of the hyper multiplets in 
the (2Ar, 8) of Sp{N) x 0(8). Secondly, the adjoint fields of the U{k) gauge theory in IIB 
splits into adjoint and symmetric representations of SO{k) under the ft ■ Z2-projection 
as indicated above. Finally the (— l)-3-brane states satisfy a reality condition; 



The (— l)-brane action for these fields is 

S = {^-Sq + Sk + Sd) 
9-1 



(3.1) 



(3.2) 



where 

Sg = trfc{[6^^,6^^]2 + [6^6'^']2 + [6^^,6'^]2+A"^[6^y,$^] + 2|i^ 
Sk = trfc{[6^^, a'^^f + [6", a'^^f + b'^^wtwlbAY + 6«<<6" + M 

, k/Y\u- A^'ai , k/A\i+ KA'au , ,.Ai Y , .4.-.,. , , 



= ..kx,u ,u^^f + r,a'^^f + h^^wtwlhAY + h'^wtwlW + M2[bAYM''''] 
+^^[h-MY]+^a[b'^MX]} + ^^'^bAY^J^ + lJi^h-iXA + IJ?^h' 
Sd = ^trfc{K^,>^'"^]Ai + [a'^^M'''']^ + /^''"<*dy + M^"<Ao 



(3.3) 



8 



Here D^h is an SU{2) triplet of auxiliary fields in the adjoint of SO{k). In the infrared 



Note that the remaining action Sd + Sk has the following scaling invariance: 



limit -3— (= a ) — > 0, Sq becomes irrelevant and therefore we shall drop this term. 

9~\ 



{w,a') K{w,a') 

(A,^) ^ /€-3/2(A,^) 

K ^ K^/^K (3.4) 

Moreover one can easily see that the integration measure is also invariant under the 
above scaling. Prom Sd we obtain the D-iexm. constraints. Explicitly, integrating D, ^' 
and A we find the bosonic constraint: 

{W^ + {a%{a'a')%^^ = (3.5) 

and the fermionic constraints: 

(/i^< + [A^'-^,a:,J)(,,) = 

(^M + [-M'"^,«aa])fo] = (3.6) 
where is defined through the equation 

+ {a^)^W^^ = e-^wtw^^. (3.7) 

Note that and W are respectively symmetric and antisymmetric in ij. 

It is now clear how the correspondence between the fields on the k (— l)-branes and the 
collective coordinates of the k instantons of previous section goes. The bosonic fields 
a^Q, and w°' correspond to the two components of the bosonic collective coordinate 
axia- The other bosonic fields b"^^ and b"" correspond to the coordinates introduced 
with the same notation in ( 2.19| ). The fermions Ai'"^, A4'^ , ji^^ jjtX and K, correspond 



to the Grassmann coordinates introduced with the same notation in section 2 when we 
discussed the zero modes of adjoint, antisymmetric and fundamental fermions. Moreover 
we see that the constraints in (^]^) and ( p. 61 ) are exactly the same as the ones given in 
last section and the action Sk for the fields just mentioned is the the same as the action 



m 



In order to integrate the delta function constraints (|3.5D and (|3.q ), we decompose the 
fermions yu's in terms of components ^'s and i/'s parallel and orthogonal to w respectively: 

={iih<J + ^{^^ (3.8) 



9 



The integration over the 2 x Ak{N — k) fermionic variables {u , u ) can be easily done 
since they appear in the action as ^{i/^b^^ + u^b~u^ + u^b'^u^). This then gives 
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N-k 



(3.9) 



The integration over Ak"^ out of 2 x (4A;^) fermionic variables (C^,^"^) can be done using 
the delta- function constraints ( |3.6D , which simply gives {det2kx2kWf''. Note that this 
factor cancels exactly {det2kx2kW)~^'^ coming from the Jacobian of the transformations 
(13.81). The remaining ^ integrations are over 2k{k — 1) variables, C^'s, and 2k{k + 1) 
variables, ^"^'s. 

For the integration over 4kN bosonic variables w'^^, as in ref.|||], since the integrand is 
only dependent on the gauge invariant matrix W, it is convenient to perform the angular 
integrations. This can be done following the method explained in Q. The steps involve 
firstly to bring w into a standard upper triangular form by using the gauge invariance. 
In our case, using Sp{N) gauge transformation: 



w 



( 








(3.10) 



\ . . y 

where the right hand side is an x A; matrix with quaternionic entries and the diagonal 
entries vl are the identity elements of the quaternion. This change of variables and the 
subsequent angular integration gives the following result: 

k 

d'^kN^ ^ voi( ,y\ J fr(^^y^-4^+3d2'=('=-i)^ (3.11) 

Sp[N — k) -"-j^ 

where the volume factor appearing above is the product 11^=1 yol{S'^^~^^~^^). Changing 
further the variables v to gauge invariant variables W defined in ( |3.7D we find that 
w is replaced by 

Vol(-M^) f dMfc+l)/2^0 -Q ^kik-l)/2^c ( ^)^-fc+l/2 



Moreover the integration over can be done simply be using the bosonic D-term Delta 



Finally taking into account the factor g^^^+^k coming from the normalization of zero 



function which then amounts to replacing by {o'^)^{o.'a') ^ 



mode wave functions [24|, we are left with the following integration measure 
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where 



Here 



where 



c{g,k,N) I ^Kk+l)/2^0 ^2k{k+l)^AY ^k(k-l)^a ^2k{k+l)^, 

^2k{k+l)j^'A ^2k{k-l)j^'Y ^mjQ ^2k{k+l)^A ^2k{k-l)^Y 

(det2fcx2fe WX-"^'^'' (det4fcx4fe i?)^'" exp(-5') (3.12) 
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ig,k,N) = /'^('^"^^VoK-^lf^) (3.13) 



jAB ^ ^A^r^B ^ j^^j^^ (3.14) 





and 



The above action 5', apart from the term fCb^lC, has exactly the same form as the 
one appearing in equation (4.55) of ref. The difference is that in the present case, 
due to the fi-projection, the components of the variables B-^^, C"^ and Ai''^ belong to 
different representations of SO{k). Thus the large N, saddle point analysis of can 
be adapted to our case, after keeping track of the above projection. Therefore it will 
suffice to state the steps involved and then give the final solution. One first makes the 
rescaling B ^/NB and raises the two determinants in ( p. 12] ) to an effective action 
keeping only leading terms of order N . A class of solution to the saddle point equations, 
modulo the SO{k) gauge transformation, is obtained by setting to zero all the SO{k) 
adjoint variables ,6^, with the symmetric ones, W^,b^^ and a'^^ being diagonal. This 
corresponds to the k instantons having independent positions in XJ^ (in R^) and sizes 

with i = 1, . . . ,k and fi = 1, . . . , 4, given by the diagonal elements of a'^^ and 
respectively. Moreover, the diagonal elements of 6"^^ give the positions ( a = 1,2,3 
) of the instantons on S^. In other words, each instanton is parametrized by a point 
{Xlp\ni) of AdS,xS\ 

Actually in the present case this is not the whole story. We have also another class of 
saddle point solutions which correspond to pairs of instantons splitting off the 7-brane 
world volume and sitting at the mirror points in the transverse directions to the 7- 
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brane. To illustrate this let us consider k = 2r he an even number, in this case we can 
take to be diagonal (r x r) matrix times (T2 and b^^ , a'^^ and to be diagonal 
(r X r) matrix times l2x2 subject to the condition 

+ b-^^bAY = {W'^f (3.15) 

If the r eigenvalues are different then the 0(2r) gauge group is broken to the semidirect 
product Sr X {Z2y where Sr is the permutation of the r eigenvalues and {Z2Y acts by 
reflecting the eigenvalues of b^ (i.e. 6^ ~^^)- Equation ( |3.15| ), together with the 
gauge group Sr x {Z2Y then shows that this saddle point configuration corresponds to 
r instantons on AdS^ x /Z2 (In the covering space AdS^ x there are 2r instantons 
at the image points). 

Clearly there are also other saddle point solutions intermediate to the above two cases 
where some of the instantons stay in the 7-brane world volume and others split off the 
7-brane in pairs. Moreover some of the eigenvalues may also coincide. But in all cases 
the saddle point solution has a clear interpretation of k instantons forming subsystems 
of single or "bound" instantons, some of them living in the 7-brane world volume and 
others living in the bulk AdS^ x S^/Zj^ 



4 Exact saddle points in the large-N limit 

It has been argued in Q , in = 4 context, that, after taking into account the fluctu- 
ations around the saddle point, the leading contribution to the integral, in the large N 
limit, comes from the most degenerate configuration, corresponding to the k instantons 
being of the same size and in the same position in i?*^ and S^, i.e. from the A;-instanton 
bound state in AdS^ x S^. The argument rests on the the analysis of the measure 
when two of the eigenvalues become equal. In this limit some of the previously massive 
variables become massless. The quadratic determinant of the bosonic variables there- 
fore diverges in this limit. However in a super symmetric theory the integration over 
the would-be massless fermionic variables should cancel this divergence. To see this let 
us consider k = 2 case in the M = 2 model under consideration (of course the same 
consideration will also apply to the Af = 4 model considered in Q). There are two 
possible generic saddle point solutions: 

1) 6^ = 0, and b'^^ ,a'^^,W^ diagonal with different eigenvalues, 

2) 6^ = X(T2, and b^^,aaa,W^ proportional to l2x2 (4.1) 

In the first case the 0{k) = 0(2) is broken to Z2 while in the second case it is unbroken. 
In the first case, to be explicit let us assume that the real part of only b^^ for A = Y = 1 
^In the case of an A/" = 4 Sp{N) gauge theory the coordinates (6'*^, 6*) are replaced by a six- 



component vector of variables in the antisymmetric of 0{k). The analog of (3.15) would then give, 
together with the other bosonic coordinates, the moduli space (AdSs x RP^Y (for k — 2r), in agreement 
with 0. 
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has different eigenvalues and all the other variables have equal eigenvalues. Then the 
off-diagonal components of b^^; {A, Y) 7^ (1, 1), a^^, 6^, A^"s and ^'s and the imaginary 
part of b^^, acquire masses that vanish in the limit the two eigenvalues coincide (note 
that a certain combination of the off-diagonal components of and other fields have 
quadratic terms that does not vanish in the limit of coinciding eigenvalues). Let M be 
the difference of the eigenvalues of the real part of b^^. We would now try to extract 
the dependence of the measure on M. At first sight it may appear that there are 
9 off-diagonal bosons and only 16 real off-diagonal fermions whose masses vanish in 
this limit, and therefore the integral over the massive variables diverges as M~^^"2" = 
M~^. However by using 0{2) transformation one can always bring the real part of 
b^^ into diagonal form, with the Jacobian of the transformation being d^b^^ — > (Pb^^M 
modulo the volume of 0(2), where on the left hand side the 3 6^^'s are in the symmetric 
representation of 0(2) while on the right hand side we have the 2 diagonal 6^^'s. In the 
total measure therefore M cancels as is expected from super symmetry. 

In the second case, the fact that the measure is independent of the mass is even more 
straightforward to see. b^, Ai^ and in this case remain massless and the integration 
over the massive bosonic 6"^^ and a^^ and fermionic A^'"^, and /C cancel exactly as 
expected from supersymmetry. 

The argument above can be easily extended to other values of k and for all the possible 
saddle point solutions corresponding to subsystems of instantons in the 7-brane world 
volume and in the full 10-dimensions. It is also easy to see that the same argument 
applies to the = 4 case considered in ; there is no divergence in the measure when 
the two eigenvalues coincide. 

What does then select the saddle point in corresponding to collapse of all the instan- 
tons to a common position and scale? The answer is that in all the other saddle points 
there are more fermion zero modes than the 16 corresponding to the super symmetric 
and superconformal zero modes. Indeed if there are subsystems of instanton 'bound 
states', there would be center of mass of each of these subsystems resulting in more 
fermion zero modes. In fact these extra fermion zero modes are the ones contained in 
Ai' and ( (part of /i which is parallel to w) in the decomposition of the fermion collective 

coordinates Ai = i ^ | . In other words these extra zero modes are not contained 

in u and v that are parts of /i and /i that are orthogonal to w and w respectively. If 
one considers Yang-Mills correlation functions involving operators that contain only 16 
fermions then clearly these other saddle points cannot contribute. On the other hand 
if one computes correlators involving more than 16 fermions, then as shown in Q, the 
leading order term in large limit comes when all the extra fermions (other that 16) 
appear as and P due to the fact that they transform as fundamental of SU{N) and 
the SU{N) trace gives a factor of N for each pair of ly and v'. Thus to the leading order 
in N only the saddle point corresponding to all the instantons at same position and of 
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same scale contribute. 

In the N = 2 case under consideration the same argument apphes. For any Yang-Mills 
correlators, the leading order in N arises when one takes the maximum possible fermions 
in the v and v part of the fermion collective coordinates. Of course at any saddle point 
there are at least 8 exact fermion zero modes coming from M' and Precisely 8 
exact zero modes appear when all the instantons sit in the 7-brane world volume at 
a common position and with common size. Thus Yang-Mills correlators that contain 
only 8 fermion collective coordinates M (i.e. other than the 0(8) fermion collective 
coordinates /C) will get contribution only from the saddle point corresponding to the 
'bound state' of all the instantons on the 7-brane world volume. In the next section 
we will consider such a correlation function involving four 0(8) currents. However one 
may also consider correlators involving more than 8 fermions. If the extra fermions 
can appear as u and v then the leading order in N is again given by the above saddle 
point. But as we shall see in section 5, for correlators involving operators that couple to 
Kaluza-Klein modes of closed string states on /Z2 this leading order in vanishes, 
and one gets contribution from saddle points (for even k = 2r) that correspond to r 
instantons sitting in AdS^ x /Z2. Anticipating these results, in the remaining part of 
this section we analyse these two saddle points in detail, the one where all the instantons 
sit at a common point in the 7-brane and second (for even k = 2r) when r instantons 
sit in the bulk AdS^ x 5'V^2- 

In the first case 5± = and ah the 6^^, a'^^ and are proportional to identity 
matrix with the constraint h^^bAY = iW^^)^. One can then perform the analysis of 
small fluctuations around this configuration and arrive at the following measure for the 
collective coordinates of k instantons: 



iV/ / p-^dpd^Xd^n Yl d^^'^d^^^Zk (4.2) 



A=l,2 

where is the partition function of the type-I' k D-instantons in the presence of 8 
7-branes at an orientifold 7-plane: 

Zk= j dXdWdQdQdlC exp(-trfc([X,, X^f + [6", Xif + [b", 

+9 [6-, 9] + 9[6+, 9] + er[Xi, 9]) + /C6+/C), (4.3) 

where we have assembled b^^ and a^^ into an 8- vector Xi, i = 1, ... ,8, of variables 
in the traceless, symmetric representation of SO{k), after a rescaling by Ni for each 
bosonic variable. 9 and 9 are chiral 50(8) spinors of opposite chirality in the traceless, 
symmetric and adjoint representation of SO{k) respectively. They are obtained respec- 
tively by combining with and ^ with A^'^ also taking into account a rescaling 
factor Nsg2 for each fermionic variable. In obtaining the factor N in ( [4.2| ) we have 
taken into account a factor Ar-2fe7V+fc(fc-i/2) f^.^^ Vol( /ff, J , and iV-'=('=+i)/4 from 



W integration. We should stress that in obtaining the action of 4.3, first one needs to 
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choose a specific basis for tlie 5*0(8) gamma-matrices, given by 



^ti = ltiX(^iXcri /U = l,2,3,4 

Ts = 75 X 0"! X fJi Te = 1 X (72 X (71 

Tj = 1 X (73 X (71 Fs = 1 X 1 X (72 (4.4) 

Here 7u = I ^1 and 75 = ( | are the fom' dimensional (4 x 4) matrices 

J \0 -1 J 

corresponding to S'0(4)/. The first set of sigma matrices corresponds to SU (2)/j. In this 
basis the 8 dimensional chirality operator Fg = 1 x 1 x (T3 and the charge conjugation 

operator is C = c x (72 x (73 with c = i ^ ) being the 4-dimensional charge 

\ 0-2 y 

conjugation operator. Secondly, in order to bring the interaction term involving Xi, Q 
and to the form appearing in ([4.3| ), one has to perform an O-dependent rotation on 
the above gamma-matrices. 

In the second case (for k = 2r),b^ = Ml rxr X (72 and , a'^^ and proportional 
to identity with the constraint eq.( 3.15| ). After gauge fixing and integrating over the 



massive fields, the dependence on M disappears as discussed above, and the action for 
the massless variables can again be expanded up to the quartic term. The resulting 
action has U{r) gauge symmetry and is given by: 

^/]V/ / p-''dp(fX(fVL W cf^fd^ijfZ^' (4.5) 

J \ 1 O.J I 



A=l,2;j=± 



where 



Zl^ = f (IXdh^dedQ exp(- trfc([X„ Xjf + [6^ Xif + [6^ b"']'^ 

+e[6-, 6] + e[fe+, e] + ep[x„ e]), (4.6) 

where all the variables are in the adjoint representation of SU{r) and the F matrices are 
the same as in eq.( [4.4D . Note that in this case there are 16 fermion zero modes in eq([4.5|) 
and the bosonic integral in ( [4.5| ) can be recognized as the integral over AdS^ x 6*5/^2, 
with Z2 being the Weyl group acting on the saddle point solution b^ — > —b^ subject to 
the condition (3.15) defining . The quantity Z^.^ in eq.(4.6) is exactly the r type IIB 



D-instanton matrix theory after having removed the center of mass variables which is 
given by 

5 Yang-Mills correlators in the instanton background 

After having discussed the ADHM measure and the exact saddle points in large N 
limit, we now compute some Yang-Mills correlators in the instanton background. By 
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the AdS/CFT correspondence, these correlators will be given by certain bulk terms in 
the effective action of the string theory living in the bulk. Given the fact that the Yang- 
Mills correlators will appear with the instanton action factor q^'^'^^'^ym g^T^^ i^j-^g relation 
between tym to the complexified string coupling constant r in type I', the effective 
action terms that will contribute are precisely the ones that get contribution from k D- 
instantons. It is known via heterotic-type I-type I' duality in 8-dimensions, that there are 
terms like t^F^ and t^R'^ (and their super symmetric partners) that get contribution from 
world sheet instantons, D-string instantons and D-instantons in these three dual theories 
respectively. These terms live in the 7-brane world volume in the type I' theory. However 
we will argue that there are also some bulk terms in the type I' effective action (i.e. 
living in 10-dimensions) of the form t^t^R^ and its super symmetric partners that receive 
corrections from D-instantons. We will first compute some correlators in Yang-Mills 
that in the large N limit receive contribution from the saddle point corresponding to all 
instantons sitting on the 7-brane world volume and show that they can be reproduced as 
coming from the t^F'^ and t^R'^ terms in the 7-brane bulk theory. Next we will consider 
some correlator that selects the saddle point which corresponds to instantons sitting in 
the bulk AdS^ x /Z2 and show that they come from the t^t^R"^ term in the string 
theory. 



5.1 0(8) current correlators and AdS^ propagators 

The 0(8) gauge potential couples to the flavour current in the 3-brane world volume 
theory via the term A'^J'j^ with J^^ = qT^'l^^q - qT^'lD + f]'^^T''a^aar]'X and = 
+ A^ is the Sp{N) covariant derivative. On the Yang-Mills side we are interested in 
computing a 4-point function of the currents in the presence of Sp{N) instantons. 
We will see below that this is sufficient to soak the 8 exact gaugino zero modes and 
moreover for odd instantons will soak also the 8 fundamental zero modes giving rise to 
odd parity 0(8) invariant. In the large N saddle point approximation, the correlation 
function is just given by plugging in the classical solutions of the fields. First let us 
consider the bosonic part of the 0(8) current. The scalar field (p satisfies the equation: 

D^q = \r] (5.1) 

where A and i] are the gaugino and fundamental fermion fields. Plugging in the expres- 
sions for the zero modes of A and x as given in equations ( |2.7| ) and (2.16) in terms of 
the ADHM data, we can solve the above equation with the result: 

ql = U^Mp^n.Vj (5.2) 

where the index r and u label the fundamentals of 0(8) and Sp{N) respectively, p runs 
over 2N + 2k values, and i,j run from 1 to k. 

Using now the explicit form for Ai for the case of the 8 exact zero modes for the gauginos 
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( 2.1[l| ),( p.ll ), and the saddle point solution for which 

{W%j = pHij w = 

where y = x — X, we can express the contribution of the scalars to the current J^, after 
some straightforward algebra, as 

+2r^ei((y' - p'y^ - 2y^y''cj^)^i,\ (5.3) 

The fermion part of the current V°'^T"'0'iiaa'>lA * more tricky. At first sight it 
appears that this term cannot soak the 8 exact supersymmetric and superconformal 
zero modes. Indeed the zero mode of ry" does not contain Ai^ collective coordinates 
and ??" has no zero mode of the Dirac operator. However a closer inspection shows 
that one needs to solve the classical equation for fy" in the presence of the 8 exact zero 
modes, 

Daafi" = i^aQA + V^Va) (5.4) 

Note that this equation does not have a solution for arbitrary collective coordinates 
A4^. The reason for this is that the right hand side of the above equation has a non- 
zero overlap with the zero modes for tj" given in ( p. 16 ) i.e. zero modes of the conjugate 



operator Daa)- This is evident from the N = 2 analogue of the equation (3.7) of Q 
which reads 

DaaV'^ = {X^QA + ^^Va) + Xa (5.5) 



where 



and 



^UM^fA'^MAflC + ^U^^A'^flC (5.6) 



Xa = Ubaf<^+IC (5.7) 



is a zero mode of the operator and <I>^ = I , ] is the collective 

' /^ X l2x2 J 

coordinate of 99+ appearing in ( 2.13| ). It is clear therefore that Xa is not in the image 




of the operator Daa- 

A careful analysis of the collective coordinate approach followed here (as well as in the 
previous papers [^, and others) shows that in the correlator, in the leading semiclassical 
approximation 77" should be replaced by the right hand side of eq.(p.6|). However here 
we will give a simple argument to prove this which is based on the fact that we need to 
soak the 8 exact zero modes. 

The right hand side of the expression in terms of collective coordinates is quadratic in 
A^'^'s. Since we need 8 exact zero modes and we have only 4 currents, it follows that 
each of these A^^'s must be replaced by the exact zero modes. Therefore it suffices to 
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solve eq.(5.4) in the presence of exact zero modes. In this case using eg. ( p. 14 ) one finds 
= 0. This is due to the fact that A4^AiA = for exact zero modes and the operator 



L is a positive definite operator. As a result Xa is zero and eq.(|5.6|) solves eq.(5.4) 



One can now, using eqs.(5.6), (|2.16| ), compute the fermionic part of the 0(8) current for 



S 



(5.8) 



the 7-brane saddle point under consideration. The result turns out to be identical to 
the bosonic part of the current, namely the right hand side of ( |5.3D . Thus the total 0(8) 
current is proportional to (|5.3| ). It is also easy to check that the current is conserved 
(5^ = 0). 

The 8 exact gaugino zero modes can be grouped into an 8 component chiral spinor of 8 
dimensional Euclidean space as 

/ ^al \ 

V / 

Furthermore we will use the 8 dimensional (16 x 16) T matrices introduced in ( |4.4| ). Note 
that 7^ and 75 act on 50(4)/ indices a and a, and that, from the two sets of sigma 
matrices used, the first one acts on the SU (2)^ index A, B while the second one acts on 
the two chiralities of 8-dimensional Euclidean space. Moreover the charge conjugation 
matrix C, as defined in section 4, raises and lowers the indices a, a and A. The current 
J" now becomes: 

1 ^ 

J^ix) = Yl ^"^^(1 + r9)r"^"5 ICT-IC 9[™G„]^(X, p; x) (5.9) 

m,n=l 

where G is the propagator of the gauge potentials on the AdS^ space with z = {X, p) 
being identified with a point in AdS^ bulk ||6|, ^ 

3 p^ 

Gn^,{X, p; x) = 2 , ^-^"mI^ - ^) (5-10) 

TT + (A — Xj^ 

where Jnm{z) = 5mn ~ ^^p^" • Inserting the four 0(8) currents and integrating over the 
8 exact gaugino zero modes produces the tensor and we get the result: 



4 

< 

2=1 



\{j^{xi) >YM= J d^X^d'n nti < A^{x^F^^^^^{X,p) >AdS, 

^,minim2n2m-j,n-j,m4,n4,f^(k) 



where 



4%,,4=<\{^T'^^>D-^nst (5.12) 
i=l 

Using either the computation of the D-string instantons in type I via the Matrix String 
approach or by using the heterotic world-sheet instanton result, which will be discussed 



18 



in the next section, we conclude that 



(k) 

bib2b3bi 



^(fc) 



^""''^^'■■■''JtAiJkJ'xi:! fork odd 



elk 



^2^ikT^^^(^j(bljb2jb3jbi)^(jF* 

+tr(j(^i j''2)tr(/3 j''^))C7f for k even 



(5.13) 



where 



and 



Ct 



4E 
4E 



e\k 
e\k 



for k = 4m — 2 

4E£|(fe/2)I for A; = 4m 



2 E^lfe £ 

2 E^lfc 7 ~ E 



£|(fc/2) 7 



for A; 
for k 



Am 
4m 



In ( 5.13| ) J's are the 0(8) generators in the vector representation, r = a + i/gstr with 
a being the type I' 0-form RR potential and in the second equation on the right hand 
side 6j's are totally symmetrized. Note that the k odd term above gets contribution 
only from the 0(8) odd parity invariant. This could be seen directly at the level of 
D-instanton action. Indeed the the 0(8) x 0{k) fermions /C couple only to the 0{k) 
gauge fields 6"*" in the D-instanton action. Integrating the K, therefore gives (det6+)'* 
in the vector representation of 0{k). For odd k, has always at least one zero mode 
for generic values of 6^ . Thus to get a non zero result one has to soak the fermion zero 
modes, which is acomplished by the insertions of 8 /C appearing in eg. ( ^.12 ), arising 
from the four 0(8) currents. Soaking these zero modes brings about the 8-rank e tensor 
in eq.( 5.13| ) for odd k. 

So far in the above discussion, the part of the measure has played no role apart 
from giving an overall volume factor. This is because we were considering correlators 
of the 0(8) currents which couple on the AdS^ side to the lowest Kaluza-Klein modes 
of the 0(8) gauge fields on S^. There are two types of higher Kaluza-Klein modes one 
can consider: that of the closed string states such as dilaton, graviton etc. and that of 
the 7-brane world volume fields namely 0(8) gauge fields. For the closed string fields 
Kaluza-Klein modes will be on S^/Z2 while for the 7-brane fields these modes will be 
on and therefore one would expect the integral to be on the 7- brane world volume 
namely AdS^ x S^. In particular the correlators involving Yang-Mills operators that 
couple to the Kaluza-Klein modes coming from the 7-brane fields, will get contribution 
only from 7-brane saddle point. These correlators can be calculated exactly as in the 
case of = 4 theory discussed in and one can show that they probe the part of 
the space-time. 
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5.2 Correlators related to bulk terms 

We will now consider a correlator which will get contribution from the saddle point with 
6^ 7^ that probes the full AdS^ x S^/Z2- It is clear that such correlators must involve 
operators that do not carry 0(8) quantum numbers. Such operators can therefore be 
obtained by projection from the = 4 operators. In the AA = 4 context the operators 
Qab _ f^^a^^b ^20) of SO{6) (i.e. traceless symmetric tensor of 2 S0{6) vectors, 

with a,b here labelling the SO{6) vectors) carry dimension 2, and they couple via 
AdS/CFT correspondence to a certain Kaluza-Klein mode J of the scale factor /i" and 
the 4-form potential Cap^yS on . The combination J of these two fields given by 

J{x)=f {K + e"^^'PC^p^sD,)Y^''^ (5.14) 

where Y^"^^ is the second spherical harmonic on S^. In other words the relevant expan- 
sions of /i^ and CaP'yS are 

h^ = J{x)Y^^\ C^pyS = J{x)e^MSpD'y^^^ (5.15) 

The projection to 7^ = 2 splits (20) of SO{Q) into (3, 3)o, (1, 1)±2 and (1, l)o of SU{2)a x 
SU{2)y X U{1), the representations (2,2)±i being projected out. On the Yang-Mills 
side these operators are respectively ticj)^^ cf)^'^ (where A, B and X, Y are symmetrized), 
tv{(j)^)'^ and tT(p'^(p^ . On the AdS side these operators couple to field J mentioned above, 
where the spherical harmonics Y^'^^ is restricted to even ones under the Z2 projection. 

The simplest correlator is the one involving four operators 0(3 3) = ii cj)^^ cf)^-^ with 
A,B and X,Y symmetrized. In the large-N limit, we must replace the fields by their 
classical solution with the result: 

0(3,3) = ^tiU{M^fM^^ + fM'^^)UUM^ fM^^U (5.16) 

The correlator then would involve 8 Ai^^s which will soak the 8 exact zero modes, 
leaving behind 8 A^^'s. This correlator gets contribution from both the saddle points 
described in the previous section: 

1) When all the instantons sit at the same point in the 7-brane world volume (i.e. 
6± = 0). In this case using the fact that appear in the action in the combination 
i>^i>^by\Y + i^^i^Yb'^ and the fact that b"*" = in this saddle point, we conclude that all 
the 8 A^^'s give rise M'^'s and C^'s. The scaling of (A4')^ and by ^N~^^^ and 
the measure factor Ng^ in eq. ( [4.2] ) gives rise to a term which goes as order one in g and 
N times an 0(2r) Matrix Theory correlator of 8 0(2r) adjoint fermions in the matrix 
theory integral. In the supergravity theory this should correspond to 7-brane tsR^ and 
tsiR"^)^ terms together with the terms involving the 4-form potential. Such terms via 
T-duality and S-duality should be obtainable from the heterotic one loop computation 
involving gravitons and anti-symmetric tensor fields. 
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2) When r instantons sit at a common point in AdS^ x S^/Z2 (with the other r instantons 
sitting at the image point) there are 8 zero modes of Ai^^s as well that are not lifted 
and the resulting matrix theory is that of SU{r) theory of type IIB instantons. Thus 
the result should be the same as in the type IIB case where this correlator is expected 
to get contribution from tgtgi?^ (and terms involving 4- form potential). The measure 
factor "v/iV can be understood as follows. The 10-dimensional integral of goes as 
~ g'^N with L being the radius of S^. The factors of g cancel due to the fact 
that the leading D-instanton contribution to goes as 1/g [§, ^ . Note that in type 
I' theory, the 0-form RR field x is not projected out and therefore the 10-dimensional 
type IIB D-instanton contributions would survive in type I' theory. 



6 String theory computation of F'^ terms 

In this section we discuss the F'^ computation for SO (8)^ heterotic theory in 8 dimen- 
sions. The world sheet instantons of the heterotic theory are then mapped via S-duality 
to D-string instantons in type I theory, which in turn are mapped via two T-dualities 
to (— l)-brane D-instantons in type I' theory. In the present context of the near horizon 
limit of the 3-branes lying at an orientifold plane where 8 of the 7- branes live, we are 
interested in all the four F's in the same 50(8) factor. There are three independent 
quartic invariants of SO (8): 

tr , (tr ) , e Fi-^i2Fi^i^Fic^igFi,j.ig (6.1) 

Here tr denotes trace in the vector representation of 50(8) and e is the 8-rank anti- 
symmetric tensor in the vector representation, Fij = Fa{J^)ij with J" being the 50(8) 
generators in the vector representation. Note that the first two invariants are 0(8) 
parity even while the third one is 0(8) parity odd due to the e tensor. The amplitudes 
involving the first two invariants, namely tr F^ and (tr -F'^)^, have already been computed 



in |T^, 18], with the result 

A^'^' = 4[log|r?(4T)|4-21og|r?(2T)|2]-41og[T2C/2|r/(i7)|4], 

A^' = -^[log|r?(4r)|4-log|^(2r)p] (6.2) 

Here T is the complexified Kahler modulus of the torus T = Bi2+iRiR2- The coefficient 
of e^'^*""^ in the above denotes the contribution of n world sheet instantons to the 
amplitude. Note that there are only even number of instantons contributing to these 
two 50(8) invariants. We shall now compute the last invariant, namely the 0(8) parity 
odd invariant. We will see that only odd instantons contribute to this term. 

50(8)^ theory is best seen as a Z2 x Z2 orbifold of heterotic 50(32) theory compactified 
on a torus of radii 2Ri and 2i?2 • The orbifold group is generated by two elements g and 
h where g is half shift along first direction together with the Wilson line {sp, sp, 0, 0) 
in the decomposition of 50(32) in terms of 50(8)^ and h is the half shift along the 
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second direction together with the Wilson hne (sp, 0,sp, 0). Here sp = (^)^ denotes 
the highest weight of the spinor representation of (5*0(8). Including all possible twists 
along a and t directions of the world-sheet torus, we find 16 sectors which split into 5 
modular orbits: one containing the completely untwisted sector, 3 orbits containing 3 
sectors each and one orbit containing 6 twisted sectors. Denoting by (a, h) the twisted 
sectors with twist a along a and h along t directions, we can represent these orbits as 
(1,1) for the completely untwisted sector, (1,^), (l,/i) and {l,gh) for the three orbits 
containing 3 sectors each and finally {g, h) for the orbit containing 6 sectors. The first 4 
orbits contribute to the 0(8) even parity invariants and they have been already studied 



in [17, 18]. The last orbit represented by {g, h) contributes to the 0(8) odd parity term. 

The instanton numbers of course are governed by the windings along a and t directions. 
Let us denote by (ni,n2) the windings of {Xi,X2) along a direction and (mi, 771,2) that 
along t direction. World sheet instanton action is (2i?i)(2i?2)|nim2 — n2?n,i|. Due to 
shifts associated with g and h the windings in these representatives of the 5 modular 
orbits are: 

(1,1) : (ni,n2;mi,m2) 
(1,5) : (ni, 712, mi + -,7712) 

(l,/i) : (77i,772;mi,m2 + ^) 

{l,gh) : (77i,772;mi + ^,m2 + ^) 

1 1 

{g,h) : (771 + -,772;mi,m2 + -) (6.3) 

Instanton number being invariant under the modular group, it is clear that in the first 
4 orbits the instanton action is even number times R1.R2 while in the last orbit it is 
odd number times i2i.i?2- 

Let us consider the 50(32) fermion partition function. In the {g, h) sector, we have a 
twist along a direction by {sp, sp, 0, 0) and along t by {sp, 0, sp, 0). This means that the 
characteristics of theta functions shift (in groups of four) by (1/2, 1/2), (1/2,0), (0, 1/2) 
and (0,0) respectively. Now in the original SO(32) theory one has the sum over all 
spin structures for all the 32 fermions simultaneously. The shifts in the characteristics 
mentioned above imply that the partition function now becomes: 

3I6 I /)16 I old _i_ /)16 



"3 +174 +[72 "l"2"4"3 + "2"l"3"4 + 

6/4 6/3 6/2 



AaAaAaA + epjepf (6.4) 



This partition function is of course zero because of the appearance of Of in each term on 
the right hand side. However since F'^ vertex operators contain 4 Kac-Moody currents, 
they can in principle give non-zero answer. Indeed if we take for instance the four Kac- 
Moody currents to be in four different Cartan directions of a given 5*0(8), then one 
of the terms in the right hand side will contribute since the effect of introducing these 
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currents is to take derivatives of the appropriate 9{t, z) with respect to z at z = 0. The 
result therefore becomes: 

e'{e^^eiel = 2^^'' (6.5) 

Remarkably rf^ cancels the ll-rf^ coming from the partition function of the oscillator 
modes in the bosonic string sector (the right moving sector) of heterotic string. Left 
moving part of the heterotic string, i.e. the fermionic string sector, gives the usual 
ts tensor in the presence of 4 gauge field vertices as can be easily seen in the Green- 
Schwarz formalism. Indeed each of the F vertex contains two Green-Schwarz fermions 
that soak the 8 fermion zero modes in the light cone gauge and all the non-zero mode 
determinants cancel due to space-time super symmetry. Thus the final result for the 
coefficient Z{T, U) of the 0(8) odd parity term e^'^'"^^ Fi-^^i^Fi^i^Fi^igFi^ig is just given by 
the 2-dimensional lattice sum of the windings.: 

ZiT,U)= [ ^l4r2ye8-|rf^**^|Te-^l(W(Ji)r (5.6) 



where 



M=("'+' ":,), (6.7) 



"-2 "l2 + ^ 

with Hi and rrii being integers. U is the complex structure of the torus and M is 
the fundamental domain of the r2 subgroup of SL(2, Z) defined as the set of matrices 
f a b\ 

with b and c even integers. Note that M has 6 copies of the fundamental 

\c d J 

domain of SL{2, Z) owing to the fact that the orbit of (g, h) consists of 6 twisted sectors. 
One can now use suitable elements of r2 to set n2 = and the result is the unfolding of 
the domain M to the full upper half plane. The integration over the upper half plane 
yields the result: 

Z{T,U) = 2{\og\r,{T)\^Ud (6.8) 

where the subscript odd indicates projection onto odd powers of e^'^'"^. Notice that there 
is no U dependence since in this sector there is no degenerate orbit. 

Equations (6^) and ( |6.8D give the complete F^ terms in the 50(8)^ heterotic theory 
in 8-dimensions. In type I also one can do an analogous calculation involving D-string 
instantons wrapped on the torus following the methods of The basic idea 

here is that in the infrared limit, the theory of N D-strings collapses into a symmetric 
product of N copies of heterotic string (in the static gauge) . The instanton contribution 
is obtained by considering the one loop amplitude involving 4 F vertices with a and 
t being identified with Xi and X2 respectively, as is dictated by the static gauge. We 
will not give the details here but a trivial extension of the results of |16, 15] after 
including the Wilson lines in g and h yields the same result as the heterotic string one 
loop result. Finally in the type I' theory which is obtained by 2 T-dualities on type I 
theory, the coupling should be the same as in type I, however a direct computation 
of D-instanton contributions in type I' theory is an interesting open question. 
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7 Conclusions 



In this paper we studied the multi-instanton effects in AA = 2 Sp{N) Yang-Mills theory 
that appears in the 3-brane world volume in the type I' theory (2 T-dual of type I). 
We showed that the ADHM construction of the multi-instantons gives rise to collective 
coordinates which can be interpreted as the fields living in the (— l)-brane instantons in 
the presence of 3-branes in type I'. The saddle points in the large N-limit describes (—1) 
brane instantons sitting at various points in the 7-brane world volume {AdS^ x S^) or 
in the 10-dim bulk {AdS^ x /Z2) that appears as the near horizon limit of the 3-brane 
solutions. We further discussed the nature of the exact saddle points in the large-A^ 
limit and argued that there are two distinct classes of exact saddle points, one where all 
the instantons sit at the same point in the 7-brane world volume and the other when 
all the instantons sit at a common point in the 10-dim bulk. The latter is of course 
possible only for even number of instantons since there has to be an equal number of 
instantons at a given point and its image under the Z2 action. While the 7-brane saddle 
point measure is order 1 in N, the bulk saddle point measure goes as \/]V. 

In the 7-brane saddle point there are 8 exact fermion zero modes and the measure splits 
into an integral over AdS^ x S"^ times a matrix integral over the (—1) brane world volume 
theory {0(k) gauge theory) that appears in type I' where the center of mass variables 
have been factored out. This matrix integral via 2 T-dualities is related to D-string 
instanton integrals in type I (which can be evaluated in the Matrix-String approach of 
[p7|) and via a further S-duality is related to 1-loop world-sheet instantons in heterotic 
theory. We computed 4 0(8) current correlator in the Yang- Mills theory which receives 
contribution only from the 7-brane saddle point as is to be expected from the fact the 
0(8) gauge fields live only in the 7-brane world volume, and showed that the result is 
obtainable from terms in the 7-brane world volume via AdS/CFT correspondence. 
A novel feature we find is that also the odd instantons contribute to such correlators in 
the Yang-Mills side and to term on the string theory side where it appears as 0(8) 
odd parity quartic invariant. In particular this shows that BPS instantons break 0(8) 
to 50(8) in contrast with the situation in 10-dimensional type I theory where 0(32) is 
broken to 50(32) due to the non BPS Z2 instanton [p^ ]. 

We also discussed some Yang-Mills correlators that do not involve 0(8) quantum num- 
bers. In this case only the even instantons contribute and both the saddle points are 
relevant. These correlators are given by the R'^ couplings (and their supersymmetric 
partners) on the 7-brane world volume and in the 10-dimensional bulk respectively for 
the two saddle points: 

1) The 7-brane coupling is of the form tsR^ and ts{R'^)'^ that appears via T and 
S-duality at 1-loop in the heterotic theory. The (— l)-brane instanton contribution to 
such term is given by 1-loop world sheet instanton effects in the heterotic theory. These 
are the super invariants Ii and I3 in the notation of |29|, which are related to anomaly 
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cancelling CP odd term and therefore are expected to satisfy non-renormalization the- 
orem. In the type I' side this result should be obtainable by computing 8 fermion 
correlator (these are the zero modes that are lifted and carry (—1) charge under 0{2) 
R-symmetry) in the 0{2k) matrix integral (where the center of mass has been factored 
out). It is an interesting open problem to work out this matrix integral and show that 
it correctly reproduces the tensor structure of the Ii and I3 invariants as well as the 
coefficients in the instanton expansion. However we expect this to be true due to the 
non-renrmalization theorem associated with these invariants. 

2) More interesting and perhaps somewhat unexpected is the contribution of the 10-dim 
bulk saddle point. In this case besides the 8 exact supersymmetric and superconformal 
zero modes (that transform as (2, l)+i under SU (2) a x SU{2)y x 0(2)) there are 8 more 
exact fermion zero modes that transform as (l,2)_i. The measure factorizes into an 
integral over the bulk AdS^ x S^/Z2 together with these 16 fermion zero modes times 
SU{k) matrix integral (where 2k is the number of instantons) appearing in the type 
IIB context. This is exactly the situation for the k type IIB (—1) brane instantons 
and therefore should produce ts-tgR^ term (and its supersymmetric partners). This 
superinvariant (called Iq in [|^) appears at the tree level and the one loop torus level 
in type I and type I' (since the computation is the same as in type IIB) as well as at 
the tree level in the heterotic theory. Iq superinvariant is not expected to satisfy any 
non-renormalization theorem. Indeed it has been argued in [29| that the heterotic- type 
I duality demands that Iq receives correction to all loops already in the 10-dimensional 
theory. In the type I' theory under consideration (i.e. IIB on T^/Z2.(— 1)^^ .^2) the 
(— l)-brane instantons of the IIB theory are not projected out. Therefore in the large 
volume limit of we expect the (— l)-brane instanton contributions to the Iq in IIB 
theory in 10-dim to survive. This is exactly the term which contributes to the instanton 
effects in the corresponding Yang-Mills correlators arising from the bulk saddle point. 
In fact this saddle point is dominant and goes as ^/N in the large A^- limit, due to the 
fact that integral is also over the 2-directions transverse to to 7-brane and its volume 
goes as gstN (the factor ^/g^ cancels from the that appears in the leading 

instanton contribution to [|3|, |[ ) . 

An interesting open question is what is the fate of the type I' Iq invariant in type I and 
heterotic theory. By the duality relations one finds that the leading instanton term in 
type r is mapped to 

Tt, k r ^ I'Ti r 



e / (fxRp ,^ e / (fxR 



91' J \/Ti.gi 



^e-^^'^ I (fxRl (7.1) 



where subscripts I and h refer to the variables in the three theories, and T is the 
volume of the torus. Note that in the heterotic theory this expression does not make 
sense due to the odd power of gn- This problem already appears at the 10-dimensional 
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level, as discussed by [29| with a possible resolution being that both in type I and 
heterotic side this term should receive corrections to all orders. 



Acknowledgments 

We thank Massimo Bianchi for useful discussions. This work was supported in part by 
EC under the TMR contract ERBFMRX-CT96-0090. M.H.S. would hke to thank Jozef 
Stefan Institute, SISSA and ICTP for hospitality during the course of this work. 



References 

J. Maldacena, The large N limit of superconformal field theories and supergrav- 
ity, Adv. Theor. Mat. Phys. 2 (1998) 231. 

N. Dorcy, T.J. HoUowood, V.V. Khoze, M.P. Mattis and S. Vandoren, Multi-Instanton 
Calculus and the AdS/CFT Correspondence in N=4 Superconformal Field The- 
ory , |hcp-th/990l"T2^ . 



M. Green and M. Gutperle, Effects of D-instantons Nucl. Phys. B498 (1997) 195. 

T. Banks and M.B. Green, Nonperturbative effects in AdS^ x string theory and 



D=4 SUSY Yang-Mills, |hep-th/9804170| . 



M. Bianchi, M.B. Green, S. Kovacs and G.C. Rossi, Instantons in supersymmetric 
Yang-Mills and D-instantons in IIB superstring theory, JHEP 08 (1998) 013. 

E. Witten, Anti de Sitter Space and holography, bep-th/980215(]| 



S.S. Gubser, I.R. Klebanov, A.M. Polyakov, Gauge Theory Correlators from Non- 
Critical String Theory, Phys. Lett. B428 (1998) 105. 

A. Fayyazuddin and M. Spalinski, Large Superconformal Gauge Theories and 
Supergravity Orientifolds , Nucl.Phys. B535 (1998) 219. 

O. Aharony, A. Fayyazuddin and J. Maldacena, The Large Limit of A/" = 2, 1 Field 
Theories from Threebranes in F-theory , JHEP 9807 (1998) 013. 

A. Sen, F-theory and Orientifolds, Nucl. Phys. B475 (1996) 562. 

T. Banks, M.R. Douglas and N. Seiberg, Probing F-theory With Branes, Phys. Lett. 
B387 (1996) 278. 

O. Aharony, J. Pawelczyk, S. Theisen and S. Yankielowicz, A Note on Anomalies in 



the AdS/CFT Correspondence , |hep-th/9901134 



M.Blau, E. Gava and K.S. Narain, On Subleading Contributions to the AdS/CFT 



Trace Anomaly, |hep-th/990417£ 



C. Bachas, C. Fabre, E. Kiritsis, N. Obers, and P. Van Hove, Heterotic - Type I Du- 
ality and D-brane Instantons, Nucl. Phys. B509 (1998) 33; E. Kiritsis and N. Obers, 
Heterotic - Type I Duality in Z) < 10 Dimensions, Threshold corrections and 
D-Instantons, JHEP 10 (1997) 004. 



26 



[15] E. Gava, J. F. Morales, K. S. Narain, and G. Thompson, Bound States of Type I D- 
Strings, Nucl. Phys. B528 (1998) 95; M. Bianchi, E. Gava, K.S. Narain and F. Morales, 
D-strings in unconventional type I vacuum configurations, Nucl. Phys. B547 (1999) 
96. 

C. Bachas, Heterotic versus Type I, Nucl. Phys. Proc. Suppl. 68 (1998) 348. 

W. Lerche and S. Stieberger, Prepotential, Mirror Map and F-theory on K3 , Adv. 
Theor. Math. Phys. 2 (1998) 1105. 

M. Gutperle, Heterotic/type I duality, D-instantons and a N=2 AdS/CFT cor- 
respondence, hep-th/9905173| . 

M. Bianchi, talk given at the ICTP Extended Workshop on String Duality, June '99, to 
appear. 

T.J. HoUowood, V.V. Khoze and M.P. Mattis, Summing the instanton series in an 
N=2 supeconformal large N QCD, |hep-th/9905"209| . 

T.J. HoUowood and V.V. Khoze, ADHM and D-instantons in orbifold AdS/CFT 



duality, |hcp-th/9908035 



E. Witten, Small Instantons in String Theory Nucl. Phys. B460 (1996) 541; Sigma 
Models And The ADHM Construction Of Instantons, J. Geom. Phys. 15 (1995) 
215. 

M. Douglas, Gauge Fields and D-branes, J. Gcom. Phys. 28 (1998) 255. 
C. Bernard, Phys. Rev. D19 (1979) 3043. 



E. Witten, Baryons and branes in Anti de Sitter Space, hcp-th/9805112 



D.Z. Freedman, S.D. Mathur, A. Matusis and L. Rastelli, Correlation functions in the 
CFT(d)/AdS(d-M) correspondence , |hep-th/980405g . 

R. Dijkgraaf, G. Moore, E. Verlinde and H. Verlinde, Com. Math. Phys. 185 (1997) 197, 



hep-th/9608096 



E. Witten, D-branes and K-theory, |hep-th/9810188 . 

A. A. Tseytlin, Heterotic-type I superstring duality and lov^r-energy effective ac- 
tions, NucLPhys. B467 (1996) 383-398. 



27 



